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Abstract — Interference alignment (IA) has attracted great at- 
tention in the last few years for its breakthrough performance 
in interference networks. However, despite the numerous works 
dedicated to IA, the feasibility conditions of IA remains unclear 
for most network topologies. The IA feasibility analysis is chal- 
lenging as the IA constraints are sets of high-degree polynomials, 
for which no systematic tool to analyze the solvability conditions 
exists. In this work, by developing a new mathematical frame- 
work that maps the solvability of sets of polynomial equations to 
the linear independence of their first-order terms, we propose a 
sufficient condition that applies to MIMO interference networks 
with general configurations. We have further proved that this 
sufficient condition matches with the necessary conditions under 
a wide range of configurations. These results further consolidate 
the theoretical basis of IA. 



I. Introduction 

Interference has been a fundamental performance bottleneck 
in wireless communication. Conventional schemes either treat 
interference as noise or use channel orthogonalization to avoid 
interference. However, these schemes are non-capacity achiev- 
ing in general. Interference alignment (IA), first proposed in 
(Tj, significantly improves the performance of interference 
networks by aligning the aggregated interference from multiple 
sources into a lower dimensional subspace. For instance, in 
a system with K transmitter-receiver (Tx-Rx) pairs and N 
antennas at each node, the IA achieves a total throughput 
which scales as O (^f log(SNR)) 0. This scaling law is 
optimal and well dominates that of conventional orthogonal- 
ization schemes, i.e. O (AHog(SNR)). The IA solution in 
(2) is also applied to other topologies such as the MIMO- 
X channels (3| and MIMO relay channels (4) and achieves 
the optimal throughput scaling law. As such, there is a surge 
in the research interests of IA. 

To achieve the optimal scaling law of throughput, the IA 
solution in [2] requires 0((KN) 2K N ) dimensions of signal 
space, which is realized by time or frequency domain symbol 
extension. Such symbol extension approach is difficult to 
implement in practice due to the huge dimensions of the signal 
space involved. To overcome this problem, IA designs with 
signal space dimension limited by the number of antennas, 
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are proposed in (5|-[[9j for practical MIMO systems. In 
the IA designs proposed in [5]-|7], closed-form solutions 
are obtained for few specific and simple configurations. For 
instance, in (5), all Rx have 2 antennas. In [6], all nodes 
have (K + 1) antennas. And in jTJ, there are only 2 Rxs 
in the network. Moreover, in all the works mentioned above, 
each Tx only has one independent data stream. Iterative IA 
solutions based on alternating optimization are proposed for 
MIMO interference networks with general configurations in 
(8), (9). However, these approaches may not converge to the 
global optimal solution. 

When the signal space dimension is limited, the IA is 
not always feasible. Therefore, the characterization of the 
feasibility conditions under limited signal space dimension 
is the primary issue to address. In general, the feasibility 
of the IA problem is associated with the solvability of a 
set of polynomial equations, which is the focus of algebraic 
geometry (10), (TTJ. There are very few works that studied the 
feasibility condition of IA problems using algebraic geometry 
|T2|-|T5|. In |T2| , the authors studied the feasibility condition 
of IA problem in single stream MIMO interference networks 
using Bernstein's Theorem in algebraic geometry [11, Thm. 
5.4, Ch. 7]. This work has been extended to the multiple stream 
case by two parallel works p3| , and [14,15], respectively. The 
first approach in fT3) established some necessary conditions 
for the IA feasibility condition for general network topology 
by analyzing the dimension of the algebraic varieties fTQ| . 
The authors further showed that these conditions are also 
sufficient when the number of antennas and data streams at 
every node are identical. The second approach in |T4| , |T5| 
established a similar necessary conditions for the I A feasibility 
problem based on algebraic independence between the IA 
constraints. The authors further proved that these conditions 
are also sufficient when the number of data stream at every 
node is the same and the number of antennas at every node is 
divisible by the number of data streams. In summary, the afore- 
mentioned works have proposed some necessary conditions 
for MIMO interference networks with general configuration, 
but the proposed sufficient conditions are limited to specific 
configurations. 

In this paper, we develop new tools in algebraic geometry 
which allows us to address the IA feasibility issue in the 
general configuration. The newly developed tool maps the 
solvability of a set of general polynomial equations to the 
linear independence of their first order terms. Based on 
this new tool, we can extend our understanding on the IA 
feasibility conditions in the following aspects: 
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A. Further tighten the IA feasibility conditions from the 
necessary side; 

B. Propose and prove a sufficient condition of IA feasibil- 
ity which applies to MIMO interference networks with 
general configurations; 

C. Prove that scaling the number of antennas and data 
streams of a network simultaneously preserves IA fea- 
sibility; 

D. Determine the necessary and sufficient conditions of IA 
feasibility in a wider range of network configurations 
comparing with the results given in |T3)-|T5|. 

Organization: Section [TT] presents the system model and 
define the IA feasibility problem. Section |III-A| pairs the ana- 



lytical results of this paper to their contributions. Section [III-B 
provides the proofs of the results based on a new mathematical 
framework. Section [TV] gives the conclusion. 

Notations: a, a, A, and A represent scalar, vector, ma- 
trix, set/space, respectively. N, Z and C denote the set of 
natural numbers, integers and complex numbers, respectively. 
The operators (-) T , {-) H , det(-), rank(-), and Af(-) denote 
transpose, Hermitian transpose, determinate, rank, and null 
space of a matrix. And the operators (•), V(-) denote the 
ideal, and the vanishing set p6| of a set of polynomials. 
For a field /C, JC[xi,...Xj] represents the field of rational 
functions in variables x\,...,Xj with coefficients drawn from 
JC. size(-) represents the size of a vector and | • | represents 
the cardinality of a set. I(-) is the indicator function, dim(-) 
denotes the dimension of a space. span(A) and span({a}) 
denote the linear space spanned by the column vectors of 
A and the vectors in set {a}, respectively. gcd(n,m) de- 
notes the greatest common divisor of n and m, n\m de- 
notes that n divides m, and mod(n, m) denotes n modulo 
m, n,m G Z. diag n (A, X) represents a block diagonal 
matrix with submatrixes A, 



instance, diag 1 ([2, 1], [1, 2]) = 
diag°(A, ...,X), and diag [n] (A) 



, X on its n-th diagonal. For 

'0000 

oooo . diag(A,...,X) = 

H200 

diag(A, A). The sym- 



bol "=" denotes the isomorphism relation |17[ . 



II. System Model and Problem Formulation 

Consider a MIMO interference network consisting of K Tx- 
Rx pairs, with Tx k sending d k independent data streams to 
Rx k. Tx k is equipped with M k antennas and Rx k has N k 
antennas. The received signal G C dk at Rx k is given by: 



K 



Hfc,V,Xi 



/ j — kj v j x j 



(1) 



where H k j G C NkXMj is the channel state matrix from Tx j to 
Rx k, whose entries are independent random variables drawn 
from continuous distributions, G C dk is the encoded infor- 
mation symbol for Rx k, XJ k G C NkXdk is the decorrelator of 
Rx k, and Vj G C MjXdj is the transmit precoding matrix at 
Tx j. z G C NkXl is the white Gaussian noise with zero mean 
and unit variance. 



Following the previous works on IA for K -pairs MIMO 
interference networks (T2j-(T5), [18], in this work, we focus 
on the feasibility issue of the following problem: 

Problem 1 (IA on MIMO Interference Networks): 
For a MIMO interference network with configuration 
X = {(M 1 ,N u d 1 ),(M 2 ,N 2 ,d 2 ),...,(M K ,N K ,d K )}, 
design transceivers {U k G C NkXdk ,Vj G C M ' xd 4> 
fc, j G {1, that satisfy the following constraints: 

rank (Uf H fefc V fe ) = d k , Vfc, 



Uf HkjVj 



0, 



Wk^j. 



(2) 
(3) 



III. Feasibility Conditions 



In this section, we will first list the main results and pair 
them with the contributions. Then we prove these results in the 
second subsection. Readers can refer to (T9) for a summary 
of the main theoretical approaches prior to this work, and a 
brief introduction to the concept of algebraic independence. 

A. Main Results 

I) Theorems Applicable to General Configurations: The 
following two theorems summarize the main result on the 
necessary side and the sufficient side, respectively. 

Theorem 3.1 (Necessary Conditions of IA Feasibility): If 
Problem [T] has solution, then the network configuration \ 
must satisfy the following inequalities: 



mmiMj.Nj} > dj, Vj G {1, ...,#} 
max{ M J> ^2 N k}> E 



(4) 
(5) 



^sub 



fc:(fc,-)e 

^sub 



j: or (j,-)e 

^sub 



^sub 



dj (Mj - dj) d k (N k -d k )>Y,djd k , (6) 



k:(k,-)e 
^sub 



^sub 



VJsub C J, where J = {(kj) : fc, j G {1, K}, k ^ j}, 
(•,j) (or (fc, •)) G J su h denote that there exists k (or j) G 
{1, ...,#} such that (k,j) G J suh . □ 
Remark 3.1 (Tighter Necessary Conditions): ([5J is the 
newly proposed necessary condition. If the cardinality of set 
J7sub is restricted to be 1, we have that ([5} is reduced to 

mBx{Mj,N k } >d k + dj, Vj ^ k, (7) 

which is one of the necessary inequalities given in the prior 
works [ 13]-fT5|. Note that the necessary conditions given in 
Thm. |3.l| are strictly tighter than those given in |T3|-p5). □ 

Theorem 3.2 (Sufficient Condition of IA Feasibility): If the 
matrix described in Fig. [T] (denote this matrix as H a u) is full 
row rank, Problem [T] has solutions almost surely. 

The submatrices H^- e & dkd ^ d ^ Mk ^\ G 
C (d fc d j )x(d i (^-rfi)) i n pig. [I] are defined by: 

/ftfcj(dfc+l,l), ft fej (d fe +2,l), 
h k j(d k +l , 2) , hk j(dfe+2 , 2) , 



=diag[d* 



•, h k3 {N k ,l)\ 
•, h kj (N k ,2) 



\h k j(d k +14j), h kj (d k +24j),- 
diag[dj](/i fe j(l,dj+l), h kj {l,dj+ty, " 



(8) 



>,h k j{N k ,dj)J 
, h kj (l,Mj)) 
, h kj (2,Mj)) 



(Uag[dj](ft fe j(dfe,dj+1), ft fc j(dfc,dj+2),- • •, h kj (d k ,M 3 )\ 



(9) 
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Fig. 1. The matrix scattered by the coefficient vectors of the linear terms in the polynomial form of IA constraints, i.e. fl9) . 



where hkj(p, q) denotes the element in the p-th row and q-th 
column of H^, k ^ j, fc, j G {1, K}. □ 

Remark 3.2 (Interpretation of the Sufficient Condition): 
The row vectors of H a n are the coefficients of the linear 
terms of polynomials in the IA constraint ([3]). Please refer to 
([19]), ( [20] ) for details. Hence, Thm. |3.2| claims that the linear 
independence of these coefficient vectors is sufficient for the 
I A problem to be feasible. This fact is a direct consequence 
of the mathematical tool we developed in algebraic geometry, 
i.e. Lem. 3.1-3.3 Please refer to Fig. [2] for an intuitive 
illustration of this mathematical tool. □ 

Remark 3.3 (Contributions of Thm. \3.2\: In literature, suf- 



ficient conditions of IA feasibility are limited to special net- 



work configurations. Thm. 3.2 proposes a sufficient condition 
which applies to MIMO interference networks with general 
configuration. □ 



Following Thm. 3.2 we have two corollaries that depict the 
relation between network configuration x an d IA feasibility. 

Corollary 3.1 (Configuration Dominates IA Feasibility): 
Under a network configuration H a n is either always rank 
deficient or full row rank almost surely. Hence, if H a u is 
full row rank under one realization of channel state {H^}, 
Problem [T] has solution almost surely in this network. □ 

Following Cor. |3.1| we define the notation of "IA feasible 
network", if Problem [T] has solution almost surely in this 
network. 

Remark 3.4 (Numerical and Analytical Contributions): 



Cor. |3.1| highlights the fact that the network configuration 
rather than the specific channel state {H^} dominates the I A 
feasibility. This phenomenon is useful in both numerical test 
and theoretical analysis: In practice, to test the I A feasibility 



of a specific network, we only need to randomly generate 
one channel state and check if H a n is full rank. Similarly, to 
prove that a certain category of network is IA feasible, we 
can try to construct some specific channel state that makes 
H a n full row rank for all the networks in this category. In 
fact, we will exploit this property in the proof of Cor. |3.3| □ 



Corollary 3.2 (Scalability of IA Feasibility): If a network 
with configuration x = {(Afi, i\Ti,di), (M K , N K , d K )} 
is IA feasible, then scaling it by a factor, i.e. \° = 
{ (cMi , cN\ , cd\ ),..., (cMk , cNk , cdx )}, c G N preserves its 
IA feasibility. □ 

2 ) Corollaries Applicable to Special Configurations: In the 
following analysis, we show that the necessary conditions in 
Thm. 13.11 and the sufficient condition in Thm. 13.21 match in 
some network configurations. The conditions align in wider 
range of configurations than the existing results in p2|-p5). 

Corollary 3.3 (Symmetric Case): When the network con- 
figuration x is symmetric, i.e. dk = d, Mk = M, = N, 
Vfc G {1, ...,K}, and min{M, N} > 2d, Problem[T]has solution 
almost surely if and only if inequality fT0| ) is true, where 



M + N-(K + l)d>0. 



(10) 



□ 



Remark 3.5 (Backward Compatible to /[75J/J: If we further 
assume that M = N and K > 3, the feasibility conditions in 
Cor. [331 is reduced to 2N — (K + l)d > 0, which is consistent 



with the IA feasibility conditions given in |T3| . 

Corollary 3.4 ("Divisible" Case): When the network con- 
figuration x satisfies 1) dk = d, Vfc, and 2) d\Nk, Vk or 
d\Mk, Vfc, Problem [T] has solution almost surely if and only 
if inequality ( [TT] ) is satisfied, where 
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fi = WnXi+Wi2X2 fi = WilXi+Wi2X2+gi(xi, X2) fi = C% -\-Wi\Xi +Wi2X2 +9i { x l, x 2 I fi(x\, X 2 ) = 0, 




Lem 3.1: Linear Inde- Lem 3.2. Algebraic Inde- Lem 3.3: Algebraic In- 
pendence Leads to Alge- pendence is Invariant up dependence Leads to Non- 
braic Independence to a Random Constant empty Vanishing Set 



A new systematic tool that connects linear independece 
to the solvability of polynomial equation sets. 

Fig. 2. Illustration of the new systematic tool that links linear independence to the solvability of polynomial equation sets. 



J2(Mj-d)+ ^{N k -d)>d\J suh \, VJ su b C J. (11) 



k:(k,-)eJsub 



□ 

Remark 3.6 (Backward Compatible to $J2)} , ffi?] /, and fj5^): 
If we further assume that d = 1, then d\M k , d\N k for all 
k G {l,...,if}. In this case, Cor. |3.4| corresponds to that in 
|T2| . Similarly, if we require both Nk and M k are divisible 
by d, Cor. |3.4| is reduced to the feasibility conditions given 
by (14}, {BjT ^ □ 



B. Proof of the Feasibility Conditions 

1) Proof of Theorem \3J\ Note that the necessity of ^ and 



(6) is proved in |T3|-|15|. We need to prove the necessity of 
(5). 

Suppose Problem [T] is feasible. Without loss of generality, 
assume for a certain set J^ uh C J, 



E 



max 



E 



E 

k:(k,-)ej s { 



(12) 



Then for j} nh , ^ can be rewritten as: 

N k > T d 



k ^ J2 ^ 



(13) 



We will prove that if Problem [T] has a solution, ( [T3] ) must 
be true. Denote T as the set of the indices which appears in 
Jgub as Tx index but not Rx index, i.e. T = {ji, j™} = 
{j : 3k s.t. (fc, j) G J s f ub and (j, fc) J s f ub }, and denote ft as 
the set of indices which appears in h as Rx index, i.e. 1Z = 
{h,...,k n } = {k : 3js.t(k,j) G j) ub }. Denote {U£,V£} 
as one of the solution. Construct three matrices: 



r - 



V* 







V* • 








, 



... V* 



u 



'u^, o ,. 
! , 








•,u 



km - 



SI 



kmjn 



Then from ([2]) and ([5]), we have that: 

dim (span (V^-)) =^^j, dim (span (U^)) = ^^<i/c, (14) 

j'GT /cG^ 

(15) 



U^H jt Vf = 0. 



From <Tg, ^Z jeT Mj < 12 j: (. tj )ej^ h M i ^ ^ken^k, 
which means in J7lt h , the number of rows is no more than the 



^sub 



number of columns. Further note that the elements of H 
are independent random variables, we have that A/"(H q \ ) 
{0} almost surely. Therefore 

dim ( span(H T+ Vf )) = dim (span(Vf )) = V ^ (16) 

jeT 

almost surely. From fj"5] ), span(H^t V^-) _L span(U^), 



hence we have: 



^2 N k > dim (span(H^ t b Vf ) + span(U^)) 

= dim ( span(H T t V^-) ) + dim (span(U^)) 

\ ^sub / 



ken 



^2 d o + ^2 d k= Yl d i 



(17) 



From ( [17] ), ( [T3] ) is true. This completes the proof. 

2) Proof of Theorem 3.2' The IA feasibility issue is chal- 



lenging as there is no systematic tool to address the solvability 
issue of high-degree polynomial equation sets. In the following 
analysis, we first elaborate three lemmas. As illustrated in 
Fig. [2j these lemmas construct a new systematic tool that 
links linear independence to the solvability of polynomial 
equation sets. The newly developed tool is not only the key 
steps to handle the IA feasibility issue in this work, but also 
a good candidate of handling the solvability issue of sets of 
polynomial equations in general. 

Lemma 3.1: (Linear Independence Leads to Algebraic In- 
dependence) Suppose JC is an algebraically closed field. Con- 
sider L polynomials fi G tCjxi, X2 : —xs), i G {1,...,L} 
which are given by: fi = Y^j=i ^ij x j + 9i> wnere 9i are 
polynomials consisting of terms with degree no less than 2. If 
the coefficient vectors = [tin, hi2 : ... : his] are linearly inde- 
pendent, then polynomials {fi} are algebraically independent. 
Proof: Please refer to Appendi^~A| for the proof. □ 
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Lemma 3.2: (Algebraic Independence is Invariant up to 
a Random Constant) Suppose JC is an algebraically closed 
field. Polynomials fa G K[xi,X2, ...xs], i G are 
algebraically independent, and q are independent random 
variables drawn from continuous distribution in JC. Then 
9i — c i + fa are algebraically independent almost surely. 

Proof: Please refer to Appendix B for the proof. □ 



Lemma 3.3: (Algebraic Independence Leads to Non-empty 
Vanishing Set) Suppose JC is an algebraically closed field. 
If polynomials fa G JC[xi, xs], i G {1,...,L} are alge- 
braically independent, then the vanishing set of these poly- 
nomials, i.e. V(/i,...,/l) = {(x!,...,xs) • fa = 0,i G 
{1,...,L}} is non-empty. 

Proof: Pleaser refer to Appendi^fC] for the proof. □ 

In the following analysis, we prove Thm. |3.2| by applying 
the new tool developed above. First we transfer the I A problem 
(Problem [TJ into another equivalent form. 

Lemma 3.4 (Problem Transformation): Problem[T]is equiv- 
alent to Problem [2] (defined below) almost surely. 

Problem 2 (Transformed I A Processing): Find {Ufc,Vfc} 
such that rank(U/e) = rank(Vfc) = dk, Vfc and satisfy 

Proof: Please refer to Appendi2["T)| for the proof. □ 

In Problem [5J to ensure that rank(Ufc) = rank(V/e) = dk, 
it is sufficient to assume that the first dk x dk submatrix of 
Ufc, Vfe, denoted by U^, Vj^, are invertible. Then we can 
define U fe G C^ Nk ~ d ^ xdk , V 7 - G C^-^*^ as follows: 



u fc 



U fe (U^)" 1 ? d 1 = V, (vf (18) 



Then ([3]) is transformed into the following formQ 



N k -d k 



fkj Pq =h k j{p,q)^^hkj{dk^n,q)u^{n,p) 



+ ^h k j{pAj+m)vj{m,q) 

m=l 

+ ^ ^ hkjidk+nrfj+m^kin^Vjtm.q) 

n—l m—1 

N k -d k M 3 -d 3 

= h fcj>g v+^ ^ hkjjdk+n^dj +m)Uk(n,p)v 3 {m,q) 



n=l m=l 



= o 



where hkj(p,q), Uk(p,q), and vj(p,q) are the elements in the 
p-th row and q-th column of Hjy, Ufe and Vj, respectively, 

v= [fif (1,1), «f (2,1), -, «f (M -di,l), «f (1,2), 
fif (JVi -diA), «?(1,1), -, u%(N K -d K ,d K ), 
«i(l,l) ,«i(2,l) ,...,«i(A6-<4,l) ,wi(l,2) 
5i(M-<4,di) ,« 2 (1,1) ,...,VK(M K -d K ,d K )] T (20) 

! Here /c, j, £>, and g represent the index of Rx, Tx, data stream at Rx side, 
and data stream at Tx side, respectively. We intensively use this subscript 
sequence in this paper, e.g. h kjpq , c\ jpq , and c T kjpq . 



and {hkjpq} is the r-th row of H a n defined in Fig. [T] where 
r(k,j,p,q) is given by: 



k-l K 

r(k,j,p,q) = X^ fct d P ' 



-^ fc ^ t + (p-l)^+g. (21) 



fetz 



:lit=l 

^fct 



it=l 



Substituting ([19]) to Lem. [3J}{33 we can prove that Prob- 
lem [T] has solution almost surely if H a n defined in Fig. [T] is 
full row rank. 

3) Proof of Corollary \H\ Note that H all G C CxV , where 
C = Ef=iE^ ^ = Ef=idfc(M fc + - 24). H all 
is full row rank if and only if at least one of its C xC sub- 
matrices has non-zero determinant. Therefore, the statement is 
proved if the following proposition holds: 

Proposition 3.1: Under a network configuration x, the de- 
terminant of a CxC sub-matrix of H a n is either always zero 
or non-zero almost surely. 

To prove Prop. |3.1| we first have the following lemma: 

Lemma 3.5: Suppose xi,...,xs G C are independent ran- 
dom variables drawn from continuous distribution, / is a non- 
constant polynomial G C[#i, xs]. Then f(xi,...,xs) ^ 
almost surely, i.e. the polynomial evaluated at (xi,...,xs) is 
non zero with probability 1. 

Proof: When k = 1, from the Fundamental Theorem of 
Algebra (l7j, f(x\) = only has finite number of solutions. 
On the other hand, x\ is drawn from continuous distribution. 
Hence f(x\) ^ almost surely. 

For k > 2, the lemma can be proved by using mathematical 
induction w.r.t. k. We omit the details for conciseness. □ 

From the Leibniz formula [20 , 6.1.1], the determinant of 
a CxC sub-matrix of H a u can be written as a polynomial 
/ G C(hkj(p,q)) with no constant term, where k ^ j G 
{1, ...,K}, p G {1, ...,iVfc}, q G {1, Mj}. Further note that 
the coefficients of / is determined by the configuration of 
the network x- Hence, under a certain x» / is either a zero 
polynomial or a non-constant polynomial. In the latter case, 



by applying Lem. 3.5 we have that / ^ almost surely. This 
completes the proof. 

4) Proof of Corollary \3.2\ As illustrated in Fig. [3] from 
^ and ([9]), after the scaling, each (or ■) is composed 
of repeating a submatrix with independent elements cdk (or 
cdj) times. Denote the 8-th time of appearance of this matrix 
as H^-(s) (or H^-(s)). Moreover, we can evenly partition 
every HF-(s), HY,(s) into c 2 independent blocks. Denote the 



(!9) Z-th diagonal block in H^.(s) (or H^.(s)) as H^.(s,Z) (or 
H^-(s, Z)), Z G {!,..., c}. Rewritten H a n as a sum of two 



matrices, one consists of the diagonal blocks {H^(s,Z)}, 
{H^-(s, Z)} and the other contains the rest of the blocks. 
Denote the two matrices as H^ n , H^ n , respectively. 

Since H^ n , H^ n are independent, it is sufficient to show that 
H^ n is full row rank. As illustrated in Fig. |5J by combining 



{n%(s',l'):s'G{(l- 



1)4- 
-iK- 



■l,(l'-l)d k + 2,...,l'd k }} with 
-l,ll-l)dj+2,...,ld k }}, 1,1' € 



{1, c}, we obtain c 2 combinations. By collecting the blocks 
with the same combination index (1,1') in different H]y and 
H^, we obtain c 2 submatrices identical to the H a n before 
scaling. Since these submatrices are full rank almost surely 
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H£(l) 




evenly partition into c 2 blocks 



--(2,1) 

<--(l,2)--> 

—(2,2)- 



D 



"all 



1, c = 2. 

and are on different rows and columns of H^ n , H^ n is full 
rank almost surely. This completes the proof. 

5) Proof of Corollary \3.3\ For notational convenience, we 
will use notation (MxN^dj^ to represent the configuration of 
a symmetric MIMO interference network, where the meaning 
of the letters are the as same those in Cor. 13.31 

The "only if side can be easily derived from ([6]). We adopt 
the following procedures to prove the "if side: 

A. Construct one special category of channel state {H^ }. 

B. Show that H a n is full rank almost surely under the special 
category of channel state. 

C. From Cor. |3.1| if Procedure B is completed, H a n is full 
rank almost surely and hence we prove the corollary. 

Now we start the detailed proof following the outline 
illustrated above. We first have two lemmas. 

Lemma 3.6 (Sufficient Condition for Full Rankness): 
Denote = span({hjy P(Z : j G {l,...,K},j ^ 

k,p,q G {l,...,d}}) n V, where V = spanf 

V |_ J-D^xDV 

D v = K(N-d)d, D v = K(M-d)d. When TV > 2d, H all 
is full row rank almost surely if the basis vectors of all H%, 
k G {1, are linearly independent. 

Proof: Please refer to Appendi^f^] for the proof. □ 
Lemma 3.7 (Full Rankness of Special Matrices): A matrix 
H su b with the following structure is full rank almost surely. 

5 1 . H su b is composed of d x d blocks, each block is composed 
of K x K sub-blocks, and each sub-block is aggregated 
by M — d number of 1 x M — d vectors. Matrix © in 
Fig. [4] illustrates an example with d = 2, K = 2, M = 4. 

52. Denote the sub-blocks as H ss >kk', s' G {1, 

fc, k' G {l,...,if}, where s, s' denote the vertical and 
horizontal position of the block, and k, k' denote the 
vertical and horizontal position of the sub-block within 
the block (e.g. B1211 in Fig. |4j. All diagonal blocks are 
block-diagonal, i.e. ^ S skk' = 0, if k ^ k' . Denote the 
k-th diagonal sub-block in block s as B^. (e.g. B^ 2 in 
Fig.@). 

53. The elements in every B^ fc are independent random 
variables drawn from continuous distribution. 

54. B^. is independent of all the diagonal sub-blocks with 
different sub-block index, i.e. {B^ fc/ : k' ^ k} and 
all the sub-blocks in the same columns and rows, i.e. 



{Bss'kk'i ~Bs'sk'k s' ^ sovk' ^ k}. The vectors in the 
off-diagonal blocks are either 0, or independent of all 
diagonal sub-blocks, or repetition of a certain vector in 
the diagonal sub-blocks (positioned in different columns). 
S5. Define diagonal sub-blocks B^ and B^ fc/ are associated, 
if a certain vectors in sub-blocks ~B ss >kk' or B s / S fc'fe, s ^ 
s f , k ^ k' is a repetition of a certain vector in the diagonal 
sub-blocks. Each diagonal sub-block B^. is associated 
with at most one diagonal sub-block in the neighboring 
blocks with different sub-block index, i.e. B^_^ fe/ and 
Bj^-Q fc// , for some k' k" ^ k. Note that when s = 1 or 
d, each diagonal sub-block is associated with at most one 
sub-block. 



-jD 1x2 vectors 




Fig. 4. Outline of the proof of Lem. |3.7| 

Proof: Please refer to Appendi^T] for the proof. □ 
Now we start the main procedures of the proof. We first 
narrow down the scope: 

- When K = 2, the proof is straightforward. 

- If the corollary is true in the boundary cases, i.e. M + 
N = (K + it is true in general. 

- With Cor. |3.2| it is sufficient to consider the case in which 
gcd(d, N, M) — 1. In the boundary cases, since d\(M + 
N), gcd(d, N, M) = 1 gcd(d, M) = 1. 

- If d = 1, the corollary is reduced to a special case of 
Cor. [341 

Hence, we focus on cases in which K > 3, M+N = (K+l)d, 
gcd(d, M) = 1, and d > 2. To improve readability of the 
proof, we adopt a (7 x 8, 3) 4 network as an example. From 
Fig. [T] matrix H a n of the example network is given by the 
first matri^ in Fig. [5] 
A. Specify {H^ } as in Fig. [SJ in which 

P(k, j) = mod(d(mod(j -k,K)-l),N-d) (22) 
(d if mod(j-k,K)<[f], 

R(k, j) = I mod(iV- 1, d) if mod(j -k,K)= [f J +1,(23) 
[0 otherwise. 

Matrix © in Fig. [5] serves as an example of this spec- 
ification. Both ( |22| ), ( [23] ) are cyclic symmetrical w.r.t. 

2 Note that here the value of the submatrices H^. are specified. We will 
explain how we construct this specification later. 
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0000 
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of diagonal 

diagfhi 3 (l),hi 
diag(hi 3 (2) 
diag(hi 3 (3) 



ub-blocks 

(2) h 13 (2fi 

(3) <h 13 (3)). 



vectors independen 
diagonal sub-bloccs 



diag- :l (h23(l),h2k(l)J 
diag- 1 (l|i 23 (2),h 23 (2)} 
diag- 1 (h 23 (3),h 23 (3) 



diagfh 4 3(l),h43(l)jh43(l)|; 
diag(h 43 (2) ,h 43 (2)jh 43 (2) 
di a g(h 43 (3),h43(3)jh 43 {3) i 



1x5 vectors 



Fig. 5. Illustration of proving that H a n is full rank in a (7 x 8,3) 4 network. 
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Fig. 6. Specify {HU}. 



B. 



user indices k,j, i.e. index pairs (k,j) and (mod(£; + 
£),mod(j + 5)) lead to the same P(k,j) and R(k,j), 
\/S G Z. This property will help us to exploit the 
symmetry of the network configuration in the proof. 
From ([9]), each consists of d independent lx(M-d) 
vectors repeating for d times. For notational convenience, 
denote these vectors as hfcj(l) ~ hfcj(d) and denote their 
5-th time of appearance as the s-th block of H^-. The 
small matrix below matrix © in Fig. [5] has given such an 
example. As illustrated by matrix © in Fig. |5j under the 
specification in Fig. [6] we can adopt row operations to 
remove the 'T's that reappear in the same columns. From 



Lem. |3.6| it is sufficient to prove that the row vectors 
which are occupied by the 5-th block of ■ are linearly 
independent, where s, k, and j satisfy: 



s G < {mod(iV, d)- 



if mod(j-k,K)<[f\ 
,d} if mod(j-fe,K)=LfJ 
otherwise. 



-1, 
(24) 



Also note that after the row operation, the 1 ~ (d — 1)- 
th block of H^-, k = mod(j - 2, K) + 1 is replicated, 
taken a minus sign and moved to other rows. Denote 
these new submatrices as {H^ }, k = mod(j — 2, K) + 1, 
j G {1, if}. Now we can adopt Lem. 3.7 to prove the 
linear independence of the row vectors specified by ( [24] ). 
Specifically, for every j G {1, K}, select the following 



vectors: 

- When k = mod(j — 2,K) + 1: h fei (l) - h fcj (d - s) 
in the s-th block of H^-, where s G {1, d — 1}. 

- When k = mod(j - [f J -1,K) + 1: h fej (dt) - 
hfcj (d) in the 8-th block of , where d) = d + 
mod(iV, d) + 1 - s, s G {mod(N, d) + 1, d}. 

- Wfow fc = mod(j - [f J - 2,if) + 1: h^d*) - 
hjfej(d) in the s-th block of H^ , where d) = 
max (l, mod(iV, d) + 1 — s), s G {1, d}. 

- Wfcen /c = mod(j-Z,iT) + l: Z G {[f J +3,..., if}: 
all vectors in H^-. 

Then as illustrated by the small matrices on the right 
side of Fig. [5] by adopting this selection mechanism, 
we have chosen Kd(M — d) vectors, which form Kd 
number of (M — d) x (M — d) submatrices positioned on 
different rows and columns. Denote these submatrices as 
B SJ , where s G {l,...,d} and j G {l,...,if} represent 
the block and user index, respectively. Map B SJ to ■ 
in Lem. 



3.7 



where 8 and s' satisfy: s = mod(d + (d 



s')mod(M, d) - l,d) + 1. As gcd(M, d) = 1, this is a 
one to one mapping. Since the submatrices are positioned 
on different rows and columns, we can move them to the 
principle diagonal and verify that the structures required 
in Lem. |3.7| are satisfied. This completes the proof. 



6) Proof of Corollary 3.4' We first prove some key lemmas 
and then turn to the main flow of the proof. 

Lemma 3.8 (Sufficient Conditions for IA Feasibility): If 
there exists a set of binary variables {c 



kjpq ' ^kjpq 



e {0,1}}, 

kj G {1, ...,#}, k + j, p G {1,...,4}, g G {1,...^} 
that satisfy the following constraints, Problem [T] has solution 
almost surely. 



r l -\- r r =1 

^kjpq ~ ^kjpq ' 

E £4i M <^fc-*, Vfe, 



fe=i,^j p=i 



< Mj-dj, Vj, 



(25) 
(26) 

(27) 
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C kjlq 
c kjpl 



C kjd k q 
C kjpdj 



Vfc, j,q, 
Vfc, j,p. 



OR 



(28) 



Proof: Please refer to Appendi^[~G| for the proof. □ 

c k jPq ) : The binar y 

constraint allocation 



Remark 3.7 (Interpretation of c\j 



variables c 



kjpq ' ^kjpq 



represent a 



policy. An IA constraint fkjpq = (defined in ( [T9] )) can 
be assigned to transceivers with non-zero coefficients in 
f kjpq , i.e. u kp e &* N ^ or v jq G C^ N ^\ Here u kp 



kjpq 



1 



('Vjq) denotes the p (g)-th column of (Vj). c] 
( c kjpq ~ 1) means that the IA constraint fkjpq = is assigned 
to the decorrelator (precoder) for the p (q)-th stream at Rx k 
(Tx j). □ 
Remark 3.8 (Meaning of Constraints in Lem. 

• ( [25] ): Each IA constraint = is assigned once and 
only once. 

• ( [26] ): The total number of constraints assigned to the 
decorrelator of any stream, i.e. Uk p is no more than the 
length of this decorrelator, i.e. size(u/e P ) = — d^. 

Y. The dual version of I 



(27 
([28 



: The constraint assignment policy {c r kjpq , c\ jpq } is 
symmetric w.r.t. Rx side stream index p or Tx side stream 
index q. □ 
The following lemma illustrate the relation between the suf- 
ficient conditions proposed in Lem. |3.8| and the necessary 



conditions proposed in Thm. 3.1 



Lemma 3.9 (Necessary Conditions of IA Feasibility): A 
network configuration x satisfies the necessary feasibility 
condition ([6]), if and only if there exists a set of binary 



variables {c] 



€ {0,1}}, k,j € {!,..., K}, k ± j, 



kjpq ' kjpq 

p G {1, ...,dfc}, q G {1, ...,dj} that satisfy (|25])-(|27]). 

Proof: Please refer to Appendi^[Tl| for the proof. □ 
Remark 3.9 (Insight of Lem. \3.8\ \3.9\ : Prior works study- 
ing the IA feasibility problem on MIMO interference networks 
have shown that the propernes^\condii\on, i.e. ([6J, is the major 
factor that characterizes the I A feasibility conditions. However, 
^ contains G(2 K ) number of correlated inequalities. Such 
a complicated condition is hard to trace in both analysis and 
practice. 

Lem. |3.9| enables us to significantly simplify ([6]). By exploit- 
ing the idea of constraint allocation, Lem. |3.9| converts ([6| to 



(|25]h[27]), which consist of only 0(K) number of constraints. 
Lem. 3.8 shows that with an additional requirement ( [28] ) on the 
constraint allocation policy {cjj.^ , }> the I A feasibility is 
guaranteed. □ 
Now we turn to the main flow of the proof for Cor. |3.4[ 
The "only if side is directly derived from ([6]). The "if side 
is completed by adopting Lem. |3.8| Please refer to Appendi^Q] 



for the details of constructing {cjj.*- , 
25W281). 



c kj Pq } which satisf y 



IV. Summary and Future Work 

This work further consolidates the theoretical basis of 
IA. We have proved a sufficient condition of IA feasibility 

3 This terminology is first denned in 1 12], which means the number of the 
free variables in transceiver design must be no less than the number of the 
I A constraints. 



which applies to MIMO interference networks with general 
configurations and discovered that IA feasibility is preserved 
when scaling the network. Further analysis show that the 
sufficient condition and the necessary conditions coincide in 
a wide range of network configurations and provide some 
simple analytical conditions. These results unify and extend 
the pertaining theoretical works in the literature p2|-|T5| and 
facilitate future analysis on MIMO interference networks. 

Despite the progress made in the prior works and this 
work, the issue of IA feasibility is yet not fully solved. In 
particular, there may be gaps between the necessary conditions 
in Thm. 13.11 and the sufficient condition in Thm. 13.21 and 
therefore the exact feasibility conditions of IA are still not 
determined in general. Merging the gap between the necessary 
and the sufficient side shall be the direction for future works. 

Appendices 

A. Proof of Lemma [XT] 

When vectors {h^} are linearly independent, we have that 
L < S. Note that if the lemma holds when L = S, it must hold 
in general. We will use contradiction to prove the statement. 
Suppose fi, i G {1, 2, L} are algebraically dependent. Then 
from the definition, there must exist a nonzero polynomial 
p, such that p(fi, /2, •••5/5) = 0. Without loss of generality, 
denote p = po + pi + ... + pd, where pd contains all the d-th 
degree terms in p, D G N. Then we have: 

s s 
V(h,h, is) = Po+Pi(^ hijXj, ^2 h SjXj) + 



D 

(pi(gi,...,gs)^Pd(ii,i2,---Jsj)=0 (29) 



d=2 



Note that all the terms in (pi(#i, gs) + 
52d=2Pd(iui2,-,is)) have degree no less than 2, from 
<H2)> Pi(Yl^=ihijXj, ...,J2^=ihsjXj) = 0, \/x u ...,Xj G K. 



(30) 



Denote yi = J2j=i hij x j> we have that: 
Pi(yi,...,ys) = 0. 



Note that the coefficient vectors are linearly independent, 
[xi, xs] —> [2/1, ys] is a bijective linear map. Therefore, 
{yij • Us} — {xij xs} = KL S . Hence, from ( [3Q| ), we have 
that V(pi) = {^/i, ...,2/5} = JC S , which means p\ must be a 
zero polynomial. 

Similarly, when p 1 is a zero polynomial, by analyzing 
the coefficients of the second order terms, we have that 
V(p2) = JC S and therefore P2 is also a zero polynomial. By 
using mathematical induction, we can show that ^1,^2, ---Pd 
are zero polynomials and hence p a zero polynomial, which is 
a contradiction with the assumption that fa, i G {1,2, 
are algebraically dependent. This completes the proof. 



B. Proof of Lemma 3.2 



We first prove that g\ , ii , . . . , /x, are algebraically inde- 
pendent. Then the Lemma can be proved by repeating the 
same trick L times. We will use contradiction to prove 
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the statement. Suppose g\ , f 2 , . . . , /l are algebraically depen- 
dent, i.e. there exists a non zero polynomial p such that 
p(gi, fz, ■ II) = 0. Without loss of generality, denote 
p(9i,f2,...,h) = T,d=o9iPd(h,-,fL), D e N, where p d 
is a polynomial function of f 2 ~ fh- Then we can define 
polynomial p 1 " (f x , / 2 , . . . , f L ) : 



D 



d=0 



D d-1 
d=0 s=0 



(*)4 d " 1) /i (, '"*W/2,...,/ i )(31) 



where 



denotes the number of s-combination of a set with 

D 



d elements. Note that Y^d=i fiPd — p(fi, Il) is nonzero, 
and c\ is independent of the coefficients in pr>, we have that 
p^ is nonzero almost surely. However, p^(fi, f 2 , /l) = 0, 
which contradicts with the assumption that /i , . . . , /l are 
algebraically independent. This completes the proof. 



C. /Yap/ (9/ Lemma \3J\ 

Since {/^} are algebraically independent, from (21] 
Thm.0.4, Lecture 2], /C[/i, / L ] = /C[j/i, 2/ L ], where 

are variables in /C. Hence, = (z/i, 

where (zi , . . . , zz, ) denotes the ideal generated by zi , . . . , . 
Note that ideal (zi, ... : zl) is proper, i.e. does not contain 1, 
so is ideal /l). From Hilbert's Nullstellensatz Theorem 

(22) Thm. 3.1, Chap. I], V(/i, is non-empty. 



where ?4 = span({h /ejp(? : j G {1, ... ,#}, j ^ fc,p,g G 
{1, d}}). Furthermore, from Lem | E.2 and the fact that An 
B = 0, we have that the first K(N — d)d elements of h must 
be 0. By combining this fact with (33] ), we have that: 



h e ( u keA U\ 
which means the basis vectors of V,Y 



n(u keB nl), (33) 

k G A U B are linearly 



dependent. This completes the proof. 



F. Proof of Lemma \377\ 

As illustrated by matrix © and ©' in Fig. [4] we can separate 
H su b into two matrices, one consists of the diagonal sub-blocks 
and sub-blocks that are not independent of the diagonal blocks 
and the other consists of the sub-blocks that are independent 
of the diagonal sub-blocks. It is sufficient to show that the 
first matrix is full rank almost surely. From S3, each diagonal 
block is full rank almost surely. Hence, as illustrated by matrix 
© in Fig. |4j we can sequentially use row operation to make 
sub-blocks {B (d _ 1)d/cfe ,}, {B (d _ 2)(d _ 1)fe/c , },..., {B 12k k>} equal 
to and make the matrix block upper-triangular. Noticing 
the association pattern S5, and the inter-block independence 
property S4, these operations preserves the block diagonal 
structure S2 and the full rankness of the diagonal sub-blocks. 
Then we can further adopt row operation to make the matrix 
block diagonal, e.g. matrix © in Fig. [4] Since each sub-block 
is full rank almost surely, the entire matrix is full rank almost 
surely. 



D. Proof of Lemma 3.4 

Firstly, it is easy to see that a solution of Problem [I] is a 
solution of Problem [2j Conversely, since the channel state of 
the direct links {H kk } are full rank with probability 1 and are 
independent of that of cross links {H/ej}, k ^ j, a solution of 
Problem [2] is also a solution of Problem [T] with probability 1 . 



E. Proof of Lemma 3.6 
We first have two lemmas. 

Lemma E.l: In H a n, the row vectors that are related to a 
same Rx are linearly independent almost surely, i.e. for every 
k G {1,...,K}, vectors h kjpq , j G {l,...,K},j ^ k,p,q G 
{1, are linearly independent almost surely. 

Proof: From ([5]), and the fact M — d > d, we have that 
every submatrix ■ is full rank almost surely. Since for a 
given k, submatrices H^, j G {1, K}, j =^ k position on 
different rows and columns in H a n, the lemma is proved. □ 

Lemma E.2: As illustrated in Fig. [5J denote h%j pq as the 
vector consists of the first K(N—d)d elements of h k j pq . For all 
k,j,tf,ji G {1, ...,#}, k + fct, PiP t e q,q* G 

{1, ...,dj}\ hfej P9 -Lh^. tpt9t . 

Proof: Straight forward from the structure of H a u. □ 

We will prove the lemma by proving its converse-negative 
proposition. From Lem | E.lj if H a n is not full row rank, there 
must exists a non-zero vector h and set i,8 C {1,...,K}, 
A fl B = such that 



G. Proof of Lemma 3.8 

1 ) Illustration of the Proof: We first illustrate the outline 
of the proof via an example and give out the rigorous proof 
in the next subsection. 

Consider a 3 -pairs MIMO interference network with con- 
figuration x = {(2, 2, 1), (2, 2, 1), (4, 2, 2)}. The constraint 
allocation {c\ jpq , d kjpq } is given by (34]). 



(34) 



C 121l5 C 211l5 


C 3111> 


C 3221 


= 1 






C 1311' C 1312> 


C 2311> 


C 2312> 


C 3121> 


c 3211 


= 


C 121l5 C 211l5 


C 311l5 


c 3221 


= 






, c 1311> C 1312> 


c 2311> 


c 2312> 


c 3121> 


c 3211 


= 1 



From Thm. 3.2 to prove the lemma, we only need to show 
that H a n is full row rank almost surely. 

As illustrated by Fig. [7] consider the matrix H a n (we have 
rearranged the order of the rows for clearer illustration). In this 
network, we have 10 polynomials in fT9] ) and 10 variables in 
Ufc,Vj. Hence H a u is a 10 x 10 matrix. We need to prove 
that H a n is nonsingular, i.e. det (H a n) ^ almost surely. 

The major properties of H a n that lead to its nonsingularity 
are labeled in Fig. [7] We first carefully arrange the order of 
vectors {h k j pq }. In particular, index sequences (k,j,p,q) that 
satisfy cjj. • = 1 or cjj. • = 1 are placed in the upper and 
lower part of H a n, respectively. We partition H a n by rows 
according to whether c\- pq = 1 or c\- pq = 1, and by columns 
according to whether the column is occupied 



hG {u keA n k ) n (u keB u k ) 



(32) 



} or 

L kjS' AA1, - 1A a ^ inu^LiaL^va uy lciuu ill ng. i^j xl a H is 

partitioned into four submatrices. H^J and are block- 
diagonal as we have reordered the rows in H a n. As highlighted 



{HY }. Then as illustrated by Label A in 



d by mu 
Fig. fj\ H 
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Mi, 3) Mi, 4)' 


1*2312 




M2,2) 








Mi, 3) Mi, 4) 



H"' IT" "H"12 ' 

1 all! "all 

TT21 |fT22; 

.-"-all L^alll. 



— h A. Seperate H all into four submatrices, H*J, HjJ, H^J, and H^J; 
^.Li.B. Submatrices H*J, are block-diagonal; 

C. The diagonal blocks in H^J, are full rank almost surely; 

D. H^u is independent of the other three submatrices of H all . 

Fig. 7. Illustration of the matrix aggregated by vectors {h k j pq } and its 
properties. Here hkj(p, q), Uk(p, q)> an d Vj(p, q) denote the element in the 
£>-th row and g-th column of H^-, XJj~ and Vj, respectively. 



analysis for other columns and we can show that 

is a Ef=i E% 4; x Ef=i EpLi cl* p block diagonal 
matrix, with diagonal block sizes c\\, , c r ^ dK , 
respectively. From Fig. [T] ([8]), and ([9]), we have that the 
elements in a same diagonal blocks are independent of 
each other, hence det ^ almost surely. 

• H^ 2 } is full rank almost surely: Using the analysis 
similar to above, we can show that is also block- 
diagonal and det ^ almost surely. 

• H^jj is independent of H^, H^, and H^: From 
Fig. [T] ([5]), and ([9]), an element h k j(p,dj + s), p G 
{1, ri/c}, 5 G {l,...Mj — dj} only appears in vectors 
hfcjpi , . . . , hkjpdj • Hence condition ( [28] ) assure that if 
hkj(p,dj + s) appears in H^, it appears in neither of 
the other three sub-matrices. This proves that is 
independent of H^, H^, and H^. 

The three facts above show that det 7^ almost 

surely. This completes the proof. 



by Label C, all the diagonal blocks of H^, are full rank 
almost surely. Thus we have H^, are nonsingular almost 
surely, i.e. det ^ 0, det ^ 0, almost surely. 



From condition ( [28] ), if an element h k j (p, q) appears in H^, 
it will not appear in other sub-matrices of H a n. Hence, as 
illustrated by Label D in Fig. [7] * s independent of the 
other three submatrices. Then from the Leibniz formula, we 
have that det(H a n) ^ holds almost surely. 

2 ) Extending to General Configurations: We will show that 
properties of H a n illustrated by Labels A-D in Fig. [7] hold for 
generic configurations. 

Denote {c^* pg , c£*- p<? } as a set binary variables that satisfy 
([25])-([28]). Without loss of generality, suppose condition ( [28] ) 
holds for K* p J. 

Reorder the rows of H a n such that the row vectors 
which satisfy {h 



kjpq 



^kjpq 



1} appear in the up- 
per part of the matrix. To show that H a n is full row 
rank, we need to show there exists a sub-matrix H^ n G 
^(Ef = i Ef = i i# 4^MELi Ef=i, # 4^) of HaU? w hose de- 
terminant is non-zero almost surely. Construct H^ n by remov- 
ing the columns which contain the coefficients of u k (p,q), 
Vj(p\q^), where k, j, q, q\ p, and p^ satisfy: 



^kp 



<P< N k -d k , 



l + c** t <pt< Mj — dj , 



(35) 
(36) 



where eg = Y%=i c% = ££, Y? P U 4W 

In the following analysis, we will partition H a n in the same 
way as that in the example above and show that the major 
properties labeled in Fig. [7] still hold. 

• is full rank almost surely: Consider the 1 



H. Proof of Lemma p79 

We first prove the "only if side. Denote {cjj*^, c^^} as 
a set of binary variables that satisfy (|25T>-(|27l>. Then we have: 



d j (M j -d j ) + 



E 



d k (N k - d k ) 



j:(-,i)eJsub 



> 



fc:(fc,-)eJsub 
d 3 d k 



E E EEfc 



kjpq * kjpq) 



k:(k,-) q=l j 



= E 



(37) 



(38) 



dkdj 

(k,j)£j suh 

Vj7 S ub ? where ( [37] ) is true due to ( [26] ), ( [27] ), and ( [38] ) is given 
by ( [25] ). This completes the "only if side of the proof. 

Then we turn to the "if side. We adopt a constructive 
approach. In following algorithrrj^] we will propose a method 
to construct the binary variables {c^.*- , <? k j vq } anc ^ show that 
when conditions ([6]) is true, the binary variables {c£*- , c k *j pq } 
constructed by Alg. [T] satisfy ([25])-([27]). 

We first define two notions which will be used in the 
algorithm. To indicate how far the constraint assignment policy 
{ c kjpqi c kjpq} is fr° m satisfying constraints ([26]), ([27]), we 
define: 

Definition 1 (Constraint Pressure): 



K d k 



K dj 



P)q = M 3 -d 3 -Y^c\ 3W P r kp = N k -d k -^^cl jpq . (39) 



ip=i 



columns of H^ n . From ( [35] ), these columns are also the 
first c\\ (note that from ([26]), c\\ < Ni - d{) columns 
of H a n. Hence from the form of vectors {h k j pq }, we 
have that elements in these columns are non-vanishing 
if and only if index k = 1, j = 1. In H^^, only 
the first c\\ rows are non- vanishing. Repeat the same {c£ 



□ 

To update the constraint assignment policy, we introduce 
the following data structure. 

Definition 2 (Pressure Transfer Tree (PTT)): As illustrated 
by Fig. [8]\, define a weighted tree data structure with the 
following properties: 

- The weight of the nodes in this tree is given by the 
constraint pressure, i.e. {Pj q ,P£ }. 



Note that this algorithm may not be the only way to construct 



kjpq ' kjpq 
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- The constraint pressure of a parent node and its child 
nodes have different superscript, i.e. t or r. 

- The link strength between two nodes, e.g. Pj q and P kp 
is given by c kjpq , if Pj q is the parent node, or c kjpq , if 
P k is the parent node. 



. p k =i4 jpq >^mdN k -d k - 



"E^ 1 Yfq=l C ljpq > > 



□ 



Algorithm 1 (Construct {c 



kjpq ' c /c jpg 



• Initialize the constraint allocation: Randomly generate 
a constraint allocation policy, i.e. {cjj. • , c fcjpg} such 



that: c 1 



7c jpg ' c /cjpg 



G {0,1}, C 



,t 



1, e 



Vfc, g, which lead to ([6J. Hence to prove the "if side, we 
only need to prove the following proposition: 

Proposition H.l (Exit State ofAlg. [7]): When ^ is true, 
Alg. [I] always exits with Case 1. 

We prove Prop | H.l| by contradiction. ([6]) is equivalent to the 
following inequalities: 

^(Mj-dj)^ ( N k-d k )>\£subl V£ sub C£ (40) 



{1,2, ...,K}, p e {l,...,dfc}, q e {l,...,dj}. Calculate 

P k P } according to (59). 
Update the constraint allocation policy: While there 
exist "overloaded streams", i.e. Pj q < or P kp < 0, do 
the following to update {c\ jpq ,c\ jpq }: 

- A. Initialization: Select a negative pressure, e.g. 
P] q < 0. Set P) q to be the root node of a PTT. 

- B. Add Leaf nodes to the pressure transfer tree: 
For every leaf nodes (i.e. nodes without child nodes) 
e.g. Pj, with depths equal to the height of the tree 
(i.e. the nodes at the bottom in Fig. [5]): 

For every k e {1,2, ...,K}, p £ {1,...,4}: If 



(j, «) = (■ Jr ><?) 
e£ sub 



(fe,p):(fc,-,p,-) 
e£ sub 



where C = {(k,j,p,q) : fc,j G {1, ...,#}, fc 7^ j,p e 
{l,...,4},g e {1,...,^}}, (or (fc,-,iv)) ^£ sub 

denotes that there exists fc,p (or j, g) such that (k,j,p,q) G 
£ su b. If Alg. [T] exits with Case 2, from the exit condition, 
there must exist a non-empty pressure transfer tree such that: 

• Root node has negative pressure. 

• All other nodes are non-positive. This is because positive 
nodes are either "neutralized" by the root in Step C or 
separated from the tree in Step D. 

• No other nodes can be added to the tree, which implies 

c k jpq = and 4 Wg t = for any P] q , P fc r tpt in the 



^kjpq 



1, add P kp as a child node of Pj q . 



tree and P kp , P? tgt not in the tree. 



- C. Transfer pressure from root to leaf nodes: 

For every leaf node just added to the tree in Step 
B with positive pressure, i.e. Pj q ( or P£ p ) > 0, 
transfer pressure from root to these leafs by updating 
{ c kj P qi c kj Pq }- For instance, as illustrated in Fig. [8^, 



Hence, set £ su b in ( |40| ) to be {(k,j,p,q) : both P kp and Pj q 
are in the tree} that are in the remaining pressure transfer tree, 
we have: 



j-dj) 



E 



(N k -d k )-\C, 



sub I 



<?):(•> 3,-,q) (k,p):(k,- ,p,-) 

^^sub ^^sub 



to-leaf branch of the tree (red lines). Transfer pres- 
sure from Pj iqi to P) 292 by setting: 4 lilPl , 1 = 0, 



= E( M ^- E ct ^) + E(^-^- E<w 

>jV ><?) (k,p):(k,- ,p,-) (fc,p):(fc,-,p,-) (j , q) : (• , j , ■ , q) 

e^sub e/: sub e£ sub e£ sub 



kipijiqi 



= i. 4 



k!j 2 piq2 



= 0, ct • , n . =1. Hence 

' kij2Piq2 



K d k 



K dj 



we have P| igi is increased by 1 and Pj^ is reduced 
by 1. This operation can also be done for the green 
line in Fig. [8j3. 

- D. Remove the "depleted" links and "neutralized" 
roots: 

* If the strength of a link, i.e. c r kjpq or c\ jpq , 
becomes after Step C: Separate the subtree 
rooted from the child node of this link from the 
original tree. 

* If the root of a pressure transfer tree (including 
the subtrees just separated from the original tree) 
is nonnegative, remove the root and hence the 
subtrees rooted from each child node of the root 
become new trees. Repeat this process until all 
roots are negative. For each newly generated pres- 
sure transfer tree, repeat Steps B-D (Please refer 
to Fig. [8p for an example). 

- E. Exit Conditions: Repeat Steps A-D until one of 
the following cases appears. 

Case 1: All trees become empty. 

Case 2: No new leaf node can added for any of the 

non-empty trees in Step B. 

Set {4*7pQ> c fc1 } to be the current value of 



= E ( m j - d i E E c W +E ( Nk - dk -E E<W 

(j,q):(fc,i,p,<?) k=l p=l (k,p):(k,-,p,-) j = l q=l 

= E P n+ E P ^<° < 41 ) 

G\<3):(-,jV,<2) (k,p):(k,-,p,-) 
^^sub ^^sub 

which contradicts with (|40]). 



/. Construct {c£*- pg , c r kjpq } to Prove Corollary 



3.4 



Without loss of generality, assume d\N k , Vfe. Modify Alg. [T] 



in Appendb(H] to construct {4* pg , c k * pq }. 



Algorithms (Variation of Algorithm^: Adopt Alg. [1] with 
the following modifications: 



In the Initialization Step: set c 



kjpl 



^kjpdj 



u kjpl ^kjpdj- 

• In Step C: All pressure transfer operations must be 
symmetric w.r.t to index q, i.e. the operations on c k j lq 

(°W> c kjd kq ( c ljd k q) must be the same - n 
Suppose Prop l H.l| still holds for Alg. [2] Then the output of 

Alg. ^{c{% q ,cl*\ satisfies ([25j-([28j. Therefore, we focus 

on proving Prop | H.l] . 

From d39l), after initialization, we have that 



Hjpq^ljpq} Exit the algorithm. 



□ 



and P kp are symmetric w.r.t. to 

Note that if Alg.[T]exits with Case 1, we have that Mj —dj — index q, after we perform Steps A, B of the constraint updating 



pt _ 

Since all c\ jpq9 



P] d d\P^ Vn,g. 



(42) 



^kjpq' 



P t , 
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process, the pressure transfer trees are also symmetric w.r.t. to 
index q. Further note that d\Pj q9 in Step C, the symmetric 
operation is always feasible. As a result, we can follow the 
analysis used in Appendi?fT[{ and prove Prop | H.l| 
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